WHAT IS CLAIMED IS: 

1. An image processing apparatus comprising: 

moving- image input means for inputting a moving 
image composed of a plurality of frames; 
5 background- image acquisition means for acquiring 

a background image relating to the moving image that 
has been input; 

object extraction means for extracting an object 
by comparing each of the frames constituting the 
10 moving image with the background image; 

abnormal -data discrimination means for 
discriminating whether shape data representing the 
shape of the extracted object is abnormal or not; 

shape-data correction means for correcting the 
15 shape data based upon result of discrimination of the 
shape data; 

image-data correction means for generating image 
data, which represents the image of the object, 
conforming to the shape data that has been corrected 
20 by said shape-data correction means; and 

coding means for coding the shape data and the 
image data. 

2. The apparatus according to claim 1, wherein said 
abnormal-data discrimination means discriminates the 

25 necessity of correcting the shape data by comparing 
the shape data of the object from frame to frame of a 
plurality of frames that differ in time. 
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3. The apparatus according to claim 2, wherein said 
abnormal-data discrimination means includes: 

first comparison means for comparing the shape 
data of the object using a present frame and a 
5 preceding frame; 

second comparison means for comparing the shape 
data of the object using the preceding frame and a 
succeeding frame; and 

decision means for deciding that correction of 
10 the present frame is necessary if a difference in the 
shape data of the object between the present frame and 
the preceding frame is large and, moreover, a 
difference in the shape data of the object between the 
preceding frame and the succeeding frame is small. 
15 4. The apparatus according to claim 2, wherein said 
abnormal-data discrimination means includes: 

first comparison means for comparing the shape 
data of the object using a present frame and a 
preceding frame; 
20 second comparison means for comparing the shape 

data of the object using the present frame and a 
succeeding frame; and 

decision means for deciding that correction of 
the present frame is necessary if a difference in the 
25 shape data of the object between the present frame and 
the preceding frame is large and, moreover, a 
difference in the shape data of the object between the 
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present frame and the succeeding frame is large. 

5. The apparatus according to claim 2, wherein said 
abnormal-data discrimination means includes: 

first comparison means for comparing the shape 
5 data of the object using a present frame and a 
preceding frame; 

second comparison means for comparing the shape 
data of the object using frames following the present 
frame and the preceding frame; and 
10 decision means for deciding that correction of 

prescribed frames from the present frame onward is 
necessary if a difference between the present frame 
and the preceding frame is large and, moreover, a 
difference in the shape data of the object between the 
15 preceding frame and the frames following the present 
frame is small. 

6 . The apparatus according to claim 3 , wherein said 
first or second comparison means performs the 
comparison using a comparison of any of the area, 

20 perimeter, wavelet identifier, circularity, centroid 
or moment of the shape data, or a combination thereof. 

7 . The apparatus according to claim 1 , wherein said 
shape-data correction means corrects the shape data of 
the object in an Nth frame, which has been determined 

25 to be abnormal, using an (N-l)th or earlier frame 

determined to be normal and an (N+l)th or later frame 
determined to be normal. 
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8. The apparatus according to claim 7, wherein said 
shape-data correction means further includes detection 
means for detecting corresponding points in the shape 
data between an (N-l)th or earlier frame and an 

5 (N+l)th or later frame. 

9 . The apparatus according to claim 8 , wherein said 
detection means obtains amount of motion of the 
corresponding points by performing pattern matching 
with respect to one or each of a plurality of 

10 prescribed areas. 

10. The apparatus according to claim 9, wherein the 
amount of motion of the corresponding points is amount 
of movement and amount of rotation of the position of 
the corresponding points obtained by an affine 

15 transformation. 

11. The apparatus according to claim 1 # wherein said 
shape -data correction means replaces shape data in an 
Nth frame determined to be abnormal with shape data of 
an (N-l)th or earlier frame determined to be normal. 

20 12. The apparatus according to claim 1, wherein said 
image-data correction means generates image data of 
the object from a frame different from a present frame 
in terms of time. 

13. The apparatus according to claim 12, wherein said 
25 image-data correction means generates image data of 

the object of an Nth frame, which has been determined 
to be abnormal, from an (N-l)th frame determined to be 
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normal and an (N+l)th frame determined to be normal. 

14. The apparatus according to claim 12, wherein said 
image-data correction means replaces image data of the 
object of an Nth frame determined to be abnormal with 

5 image data of the object of an (N-l)th frame 
determined to be normal. 

15. The apparatus according to claim l t wherein said 
coding means is coding means compliant with an MPEG- 4 
visual coding scheme. 

10 16. An image processing method comprising: 

a moving- image acquisition step of acquiring a 
moving image composed of a plurality of frames; 

a background- image acquisition step of acquiring 
a background image relating to the moving image; 
15 an object extraction step of extracting an object 

by comparing each of the frames constituting the 
moving image with the background image; 

an abnormal -data discrimination step of 
discriminating whether shape data representing the 
20 shape of the extracted object is abnormal or not; 

a shape-data correction step of correcting the 
shape data based upon result of discrimination of the 
shape data; 

an image-data correction step of generating image 
25 data, which represents the image of the object, 

conforming to the shape data that has been corrected 
at said shape-data correction step; and 
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a coding step of coding the shape data and the 
image data. 

17. The method according to claim 16, wherein said 
abnormal-data discrimination step discriminates the 

5 necessity of correcting the shape data by comparing 
the shape data of the object from frame to frame of a 
plurality of frames that differ in time. 

18. The method according to claim 17, wherein said 
abnormal-data discrimination step includes: 

10 a first comparison step of comparing the shape 

data of the object using a present frame and a 
preceding frame; 

a second comparison step of comparing the shape 
data of the object using the preceding frame and a 

15 succeeding frame; and 

a decision step of deciding that correction of 
the present frame is necessary if a difference in the 
shape data of the object between the present frame and 
the preceding frame is large and, moreover, a 

20 difference in the shape data of the object between the 
preceding frame and the succeeding frame is small. 

19. The method according to claim 17, wherein said 
abnormal-data discrimination step includes: 

a first comparison step of comparing the shape 
25 data of the object using a present frame and a 
preceding frame; 

a second comparison step of comparing the shape 
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data of the object using the present frame and a 
succeeding frame; and 

a decision step of deciding that correction of 
the present frame is necessary if a difference in the 
5 shape data of the object between the present frame and 
the preceding frame is large and, moreover, a 
difference in the shape data of the object between the 
present frame and the succeeding frame is large* 

20. The method according to claim 17, wherein said 
10 abnormal-data discrimination step includes: 

a first comparison step of comparing the shape 
data of the object using a present frame and a 
preceding frame; 

a second comparison step of comparing the shape 
15 data of the object using frames following the present 
frame and the preceding frame; and 

a decision step of deciding that correction of 
prescribed frames from the present frame onward is 
necessary in a case where a difference between the 
20 present frame and the preceding frame is large and, 

moreover, a difference in the shape data of the object 
between the preceding frame and the frames following 
the present frame is small . 

21. The method according to claim 18, wherein said 
25 first or second comparison step performs the 

comparison using a comparison of any of the area, 
perimeter, wavelet identifier, circularity, centroid 
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or moment of the shape data, or a combination thereof. 

22. The method according to claim 16, wherein said 
shape-data correction step corrects the shape data of 
the object in an Nth frame, which has been determined 

5 to be abnormal, using an (N-l)th or earlier frame 

determined to be normal and an (N+l)th or later frame 
determined to be normal. 

23. The method according to claim 22, wherein said 
shape-data correction step further includes a 

10 detection step of detecting corresponding points in 

the shape data between an (N-l)th or earlier frame and 
an (N+l)th or later frame. 

24. The method according to claim 23, wherein said 
detection step obtains amount of motion of the 

15 corresponding points by performing pattern matching 
with respect to one or each of a plurality of 
prescribed areas. 

25. The method according to claim 24, wherein the 
amount of motion of the corresponding points is amount 

20 of movement and amount of rotation of the position of 
the corresponding points obtained by an affine 
transformation . 

26. The method according to claim 16, wherein said 
shape-data correction step replaces shape data in an 

25 Nth frame determined to be abnormal with shape data of 
an (N-l)th or earlier frame determined to be normal. 

27. The method according to claim 16, wherein said 
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image-data correction step generates image data of the 
object from a frame different from a present frame in 
terms of time. 

28. The method according to claim 27, wherein said 
5 image-data correction step generates an Nth frame, 

which has been determined to be abnormal, from an (N- 
l)th frame determined to be normal and an (N+l)th 
frame determined to be normal. 

29. The method according to claim 27, wherein said 
10 image-data correction step replaces image data of the 

object of an Nth frame determined to be abnormal with 
image data of the object of an (N-l)th frame 
determined to be normal. 

30. The method according to claim 16, wherein said 
15 coding step is a coding step compliant with an MPEG-4 

visual coding scheme. 

31. A program for causing a computer to execute the 
following: 

an object extraction procedure for extracting an 
20 object of comparing a frame of a moving image composed 
of a plurality of frames and a background image 
relating to the moving image; 

an abnormal-data discrimination procedure for 
discriminating whether shape data representing the 
25 shape of the extracted object is abnormal or not; 

a shape-data correction procedure for correcting 
the shape data based upon result of discrimination of 



- 52 - 



the shape data; 

an image-data correction procedure for correcting 
the frame using the shape data corrected by said 
shape-data correction procedure; and 

a coding procedure for coding the shape data and 

the image data. 

32. A computer-readable recording medium storing the 
program set forth in claim 31. 
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